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(54) IMAGE PROCESSOR AND ITS METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To reduce the storage 
capacity of a memory storing image data in the image 
processor and its method applying image rotation 
processing to the image data. 
SOLUTION: A coding section 505 applies Joint 
Photographic Expert Group(JPEG) coding to inputted 
image data and adds a restart marker to the coded 
jmage data every time the imag e d ata are coded byja 
p rescribed amount and stores the coded image d_at aJo 

amiroag e memory 507. A decoding section 509 reads- 

the coded data out of the image memory 507 and 
decodes the image data^asedo rLthe restart mark in a 
strip form in the subscanning direction and stores the 
decoded image data to an output buffer memory 51 1 . A 

control section 521 reads image data stored in the output buffer memory 51 1 sequentially in 
the subscanning direction and sends the data to an interface 513. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image processing system which 
processes the inputted image data, and its approach, concerning an image processing 
system and its approach. 
[0002] 

[Description of the Prior Art] It becomes the procedure of transmitting the image data 
which once stored the image data which received all the image data for one image, and 
received the image which the image data which received expresses 90 degrees or when 
carrying out rotation 270 degrees (clockwise rotation) (henceforth "image rotation 
processing") and re- transmitting in image memorandum ** etc., and was stored in the 
image memory perpendicularly with read-out. 

[0003] Drawing 1 is a flow chart explaining image rotation processing. 
[0004] In this drawing, the image data which r eceived image jdata at step S101, and 
received at step SI 03 is stored in an image memory. And SI 03 is repeated from step 
SI 01 until it judges whether all the image data of one image was received and finishes 
receiving at step 104. 

[0005] If all the image data of one image is received and stored, the read-out starting 
position of the image data according to angle of rotation of an image will be decided 
(SI 04), it will scan from the starting position to the perpendicular direction of an image, 
and image data will be transmitted for image data with read-out (SI 05) (S106). And SI 07 
is repeated from step SI 05 until it judges whether all image data was transmitted and 
finishes transmitting at step SI 07. 

[0006] In this case, in the case of a 4096x4096-pixel 24-bit full color image, the memory 
capacity of a needed image memory turns into memory capacity of no less than 48 M 
bytes depending on the maximum image size. Then, it is possible to reduce the storage 
capacity of an image memory using the JPEG (Joint Photographic Experts Group) 
method which is the international standards of a multiple-value digital still picture 
compression method. This compression method carries out orthogonal transformation of 
the picture signal using DCT (Discrete Cosine Transform), reduces information by 
removing the signal component of a part which is not visually conspicuous with the 
signal after conversion, and after that, in order to compress information further, it 
performs Huffman coding etc. Huffman coding assigns the variable-length code 
according to the occurrence frequency of a sign, in order to reduce the amount of signs. 
Therefore, in order to decode the encoded Huffman code, it is necessary to decode 



sequentially from the head of a sign. 

[0007] Drawing 2 is a flow chart which shows the example which applied JPEG coding 
to the image rotation processing shown in drawing 1. In addition, the same sign is given 
to the step which performs the same processing as drawing 1, and the detail explanation 
is omitted to it. 

[0008] In drawing 2, JPEG compression of the image data which received at step S201 is 
carried out, and the image data compressed at step S202 is stored in an image memory. 
[0009] If all the image data of one image is received, compressed and stored, the 
compression image data stored in the image memory is decoded (S203), and it stores in 
buffer memory (S204). And it judges whether decode of compression image data was 
completed at step S205, and S205 is repeated from step S203 until decode is completed. 
[0010] When all the compression image data of one image is decoded and being stored in 
buffer memory, the same processing as SI 07 will be performed from step SI 04 shown in 
drawing 1, and the image data of the image which rotated will be transmitted. 
[0011] 

[Problem(s) to be Solved by the Invention] However, there are the following troubles in 
the technique mentioned above. That is, when rotating the image which the image data 
which received expresses and transmitting the image data of the image which rotated, 
there is a problem that the mass memory which can memorize all the image data that 
received is needed. 

[0012] Even if it compresses a metaphor and the image data which received and 
memorizes to an image memory, when rotating and transmitting an image Since the 
image data which decoded the compressed image data, stored in buffer memory etc., and 
was stored in buffer memory is scanned perpendicularly and read-out and the procedure 
of transmitting are needed Although the memory capacity of an image memory is 
reducible, there is a problem that the memory capacity of the buffer memory for storing 
the decoded image data becomes large depending on image size. 
[0013] This invention aims at reducing the storage capacity of the memory which stores 
image data in the image processing system which it is and performs image rotation 
processing to image data and its approach for solving an above-mentioned problem. 
[0014] 

[Means for Solving the Problem] This invention is equipped with the following 
configurations as a way stage which attains the aforementioned purpose. 
[0015] This invention is characterized by providing the following in an image processing 
system. A coding means to add a predetermined control code to the code data whenever it 
carries out specified quantity coding of said image data, while carrying out sequential 
coding of the inputted image data in the main scanning direction A storage means to 
memorize the image data encoded by said coding means The decode means which 
decodes the code data read from said storage means based on said predetermined control 
code, and carries out the sequential output of the decoded image data in the direction of 
vertical scanning 

[0016] Moreover, the coding means which carries out JPEG coding of the inputted image 
data and the first storage means which memorizes the image data encoded by said coding 
means, A decode means to decode code data in read-out and predetermined size from 
said first storage means, It is characterized by having the second storage means which 
memorizes the image data decoded by said decode means, and an output means to read 



the image data memorized by said second storage means in predetermined order, and to 
output it. 

[0017] This invention is characterized by providing the following in the image- 
processing approach. The coding step which carries out sequential coding of the inputted 
image data in the main scanning direction The addition step which adds a predetermined 
control code to the code data, and is stored in a storage means whenever it carries out 
specified quantity coding of said image data The decode step which decodes the code 
data read from said storage means based on said predetermined control code The output 
step which carries out the sequential output of the decoded image data in the direction of 
vertical scanning 

[0018] Moreover, the coding step which carries out JPEG coding of the inputted image 
data, and stores the encoded image data in the first storage means, Code data is decoded 
in read-out and predetermined size from said first storage means, and it is characterized 
by having the decode step which stores the decoded image data in the second storage 
means, and the output step which reads the image data memorized by said second storage 
means in predetermined order, and outputs it. 
[0019] 

[Embodiment of the Invention] Hereafter, the image processing system of 1 operation 
gestalt concerning this invention is explained to a detail with reference to a drawing. 
[0020] In each following operation gestalt, subject-copy image data are full color data of 
8 bits each of RGB, and after they change this into a YUV color space, they shall carry 
out JPEG coding with the sampling rate of 4:1 :1. In this case, the magnitude of 1MCU 
(the minimum coding unit) becomes 16x16 pixels. 
[0021] 

[The 1st operation gestalt] This operation gestalt reduces the storage capacity of buffer 
memory required to store the decoded image data by decoding compression image data 
per stripe of predetermined width of face. And in order to decode compression image 
data per stripe of predetermined width of face, with this operation gestalt, the restart 
marker who is the control code of JPEG is inserted in the image data which carried out 
JPEG coding (addition). 

~[0022] It is drawing for explaining in which location of the subj ect-copy imagebefore 

compression drawing 3 inserts a restart marker . The subject-copy image data before 
compression shall be made into 4096x4096 pixels to level and a perpendicular direction, 

_and shall insert a restart marker every horizontal (main scanning direction) 256 pixels. 
Since 1MCU is 16x16 pixels as mentioned above, at least 2 bytes of restart marker will 
be inserted every 16MCU. Since JPEG coding is a variable-length-coding method, a 
restart marker's spacing in the information after coding (this is called bit stream) becomes 
in addition, lgss-fbcedr^ajrthermore, the band-like image field before the compression 
divided^b^ihe restart marfcsr will be called a stripe. The number of the stripes in drawing 

J is sefto4096/256= 16. ) 

[0023]\^^wing 4 is theJ>lock diagram showing the example of a configuration of the 
image processing system of this operation gestalt. 

[0024] The interface whose 501 receives input image data in this drawing, The input 
buffer memory which stores temporarily a part of image data which 503 received, The 
coding section which carries out JPEG coding of the image data by which 505 was stored 
in the input buffer memory 503, The image memory in which the image data by which 



JPEG coding of 507 was carried out is stored by one image, The decode section which 
carries out the JPEG decode of the code data by which 509 was stored in the image 
memory 507, the output buffer memory which stores temporarily the image data by 
which 511 was decoded, and 513 are the interfaces for outputting the image data stored in 
the output buffer memory 5 1 1 to the exterior. 521 is a control section, for example, 
consists of CPU, a ROM, RAM, etc., and controls each above-mentioned block through a 
bus 515 according to the program beforehand stored in ROM. 
[0025] Drawing 5 A is the flow chart which shows the example of a procedure of the 
coding processing in this operation gestalt, and is controlled and performed by the control 
section 521 mentioned above. 

[0026] In drawing 5 A, the image data which received image data at step S401, and 
received at step S402 is stored in the input buffer memory 503. Since the image data for 
16 lines is the need, it judges whether the image data for 16 lines was received, or all 
image data was received at step S403, and as mentioned above, if it is unfinished, it will 
return to step S401 performing JPEG coding. 

[0027] When the image data for 16 lines or all image data are received, the image data 
which performed JPEG coding at step S404, and was encoded at step S405 is stored in an 
image memory 507. And it judges again whether reception of image data was completed 
at step S406, if it is termination, coding processing will be ended, otherwise, it progresses 

to stepS^OT^^ _ . 

^Then, it judges whether coding for 16MCU was completed, or coding of a block 
line (minimum Rhine re quired to perform coding processing) was completed at step S407, 

KHf thai is right, a restart marker will be inserted at step S408 . And it judges again 
whether coding of a block line was completed at step S409, and if it is termination, since 
it is necessary to memorize a restart marker's location inserted after coding termination of 
a block line, after storing a restart marker's positional information in the pointer for every 
block line, it returns to step S401 at step S410. Moreover, if coding of a block line was 
not completed, it will return to step S404. In addition, a pointer is assigned to RAM of a 
control section 521 etc. 

[0029] Drawing 5 B is the flow chart which shows the example of a procedure of the 
image rotation processing in this operation gestalt, and is controlled and performed by the 
control section 521 mentioned above. 

[0030] The image data which decoded the code data stored in the image memory 507 at 
step S421, and was decoded at step S422 is stored in the output buffer memory 511. And 
S423 is repeated from step S421 until it detects a restart marker at step S423. 
[0031] The positional information of the restart marker who detected the restart marker at 
step S424 when the image data for 1MCU width of face of detection, i.e., one stripe, was 
decoded is stored in a pointer, and the code data for a predetermined restart marker is 
skipped at step S425. With this operation gestalt, the code data for 15 restart markers will 
be skipped. That is, although the code data corresponding to the image data under the 
Rhine part equivalent to 1MCU of the same stripe will be read, it judges [ which skipped 
at step S426 ] whether there is any code data previously, if there is code data, it will 
return to step S421, and since it will mean that the decode for one stripe had ended if 
there is nothing, it progresses to step S427. 

[0032] Then, image rotation processing mentioned above at step S427 in the image data 
for one stripe stored in the output buffer memory 5 1 1 is performed. 




[0033] Next, the processing not more than step S421 which moved to processing of the 
following stripe at step S429, and described above whether the value (a restart marker's 
positional information) of a pointer and the positional information of the restart marker of 
the last block line recorded by coding processing would be in agreement at step S428 if 
processing was ended and it was not in agreement when in agreement [ judged and ] is 
repeated. 

[0034] Thus, since according to this operation gestalt it decodes one stripe of code data at 
a time and image rotation processing is performed based on a restart marker, storage 
capacity required for buffer memory is reducible. For example, if width of face of a stripe 
is made into 256 bytes, it is 256x4096x3 bytes, i.e., 3 M bytes, and storage capacity of 
buffer memory can be made into 1/16 compared with the conventional method (48 M 
bytes). 
[0035] 

[The 2nd operation gestalt] Hereafter, the image processing system of the 2nd operation 
gestalt concerning this invention is explained. In addition, in the 2nd operation gestalt, 
about the same configuration as the 1st operation gestalt and abbreviation, the same sign 

pJ>s attached and the detail explanation is omitted. 

[0036] In the 1st operation gestalt mentioned above, although the example which inserts a 
restart marker for evervstripe was explained, as shown in drawing 6, a restart marker is 
inserted in the tai l (oi ^fieadjP jbf a block line in this operation gestalt. Therefore, the 
processing at the time of coding is simplified a little compared with processing of the 1st 

^operation gestalt. 

[0037] Drawing 7 A is the flow chart which shows the example of a procedure of the 
coding processing in this operation gestalt, is controlled and performed by the control 
section 521 mentioned above, and explains only a different part from the procedure 
shown in drawing 5 A. 

[0038] Although it judged whether coding for 16MCU was completed, or coding of a 
block line was completed at step S407 of drawing 5 A, it judges whether coding of a 
block line was completed in step S407a of drawing 7 A. 

^5039] And after coding of a block line is completed, and inserting a restart marker at 
step S408,- and there being no processing corresponding-to-step S409 of drawing 5 A, 
then storing a restart marker's positional information in the pointer for every block line at 
step S410, it returns to step S401. 

[0040] Drawing 7 B is the flow chart which shows the example of a procedure of the 
image rotation processing in this operation gestalt, and is controlled and performed by the 
control section 521 mentioned above. 

[0041] The code data for 1MCU of one block line is decoded at step S801. The positional 
information of code data [ finishing / decode ] is set to the pointer corresponding to a 
block line at step S802. The image data decoded at step S803 is stored in the output 
buffer memory 511. Each DC component is stored. Y, U, and V of the block decoded to 
the register of the lot corresponding to a block line at step S804 — If judge and it is 
[ whether there is any next block line and ] at step S805, it will move to processing of the 
next block line at step S806, and processing of S805 will be repeated from step S801. In 
addition, a register is assigned to RAM of a control section 521 etc. 
[0042] After processing of all the block lines equivalent to 1MCU width of face is 
completed, image rotation processing mentioned above at step S807 is performed, when 



it is judged and detected whether the restart marker was detected at step S808, processing 
is ended, otherwise, it returns to step S801. 

[0043] That is, in this operation gestalt, the image data of 1MCU width of face is 
processed as one stripe, and Y, U, and V which were stored in the register of the lot 
corresponding to a block line — the code data read from the image memory 507 based on 
the pointer corresponding to a block line is decoded by each DC component. And in order 
to switch a block line for every decode processing of 1MCU and to switch a block line, it 
is not necessary to detect a restart marker, and a restart marker is used in order to detect 
whether all the code data were decoded. 

[0044] In addition, although the cutting tool unit was sufficient since a restart marker's 
location was carrying out cutting tool alignment of the positional information of the 
restart marker who stores in a pointer in the 1st operation gestalt, the positional 
information stored in a pointer in the 2nd operation gestalt becomes bitwise finer than it. 
But the increasing information is only a triplet slightly. 

[0045] Thus, since according to this operation gestalt it decodes per stripe of the width of 
face equivalent to 1MCU and image rotation processing is performed, storage capacity of 
the output buffer memory 51 1 can be made into 1/16 compared with the 1st operation 
gestalt. 

[0046] Although **** explained the example which decodes per stripe of the width of 
face equivalent to 1MCU, and performs image rotation processing, it decodes per stripe 
of the width of face equivalent to a part for a MCU k (>=1) individual, and may be made 
to perform image rotation processing. If it does in this way, the storage capacity of the 
output buffer memory 51 1 can make quick the part and process speed which decrease in 
the change of processing, although it increases k times compared with processing of the 
stripe unit of the width of face equivalent to 1MCU. 
[0047] 

[The 3rd operation gestalt] Hereafter, the image processing system of the 3rd operation 
gestalt concerning this invention is explained. In addition, in the 3rd operation gestalt, 
about the same configuration as the 1st operation gestalt and abbreviation, the same sign 
is attached and the detail explanation is omitted. 

- [0048] Next, the example which applies image-rotation-processing ofthe 1 st or -2nd- 

operation gestalt mentioned above to printers, such as an electrophotography method, is 
explained. 

[0049] In case A4 recording paper is outputted, in order to make print speed quick in the 
printer of the electrophotography method corresponding to A3 recording paper generally, 
the printed output of the sense of the recording paper is carried out and carried out to a 
landscape in many cases. By the way, in almost all cases, the ****** data sent to a 
printer from a host computer are premised on the sense of the recording paper being a 
portrait. That is, the sense of the premised detail paper in case data are transmitted to a 
printer from a host computer will differ from the sense of the detail paper which a printer 
actually outputs. Then, rotation processing of an image is needed. 

[0050] The data transmitted to a printer from a host computer are divided roughly into the 
so-called PDL code and so-called image data which are represented by PostScript, PCL, 
etc. In case the former consists of a graphic command, a character code, etc. and bit map 
data are made, the so-called drawing processing is needed. Therefore, in case drawing 
processing is performed, the difference in the sense of the recording paper can be easily 



absorbed depending on how to take system of coordinates. On the other hand, since the 
latter is already bit map data when it is transmitted to a printer from a host computer, 
image rotation processing is needed after transfer operation. 

[0051] Drawing 8 is the block diagram showing the example of a configuration of the 
printer which JPEG-encodes, decodes a receipt, among those image data for two kinds of 
above-mentioned data from a host computer, and performs image rotation processing. In 
addition, the same sign is given to the configuration of drawing 4 and abbreviation 
identitas, and the detail explanation is omitted in it. 

[0052] In this drawing, the drawing section which draws bit map data according to the 
PDL code to which 905 has been sent from the host computer, and 909 are the engine 
interfaces for outputting printer engine 911 HEBITTO map data. 
[0053] The data received from the host computer through the interface 901 distinguish 
the PDL code and image data, and are stored in the input buffer memory 503. It is read to 
the coding section 505 for every data for 16 lines, and the image data stored in the input 
buffer memory 503 is stored in an image memory 507, after being compressed, as 
mentioned above. The compressed data stored in the image memory 507 is read by the 
decode section 509, after the decode and image rotation processing which were 
mentioned above using the output buffer memory 51 1 are performed, is read according to 
the printing speed of printer engine 911, and is sent to printer engine 911 through the 
engine interface 909. 

[0054] On the other hand, the PDL code of the amount equivalent to the image for 1 page 
is accumulated in the input buffer memory 503, and in order to draw sequentially from 
what should be first outputted to printer engine 91 1, in advance of actual drawing 
processing, sorting of the case of the PDL code is beforehand carried out in data. In order 
to double the sense of the recording paper in that case, if required, system of coordinates 
will be rotated. 

[0055] After reception of the PDL code equivalent to 1 page is completed, the PDL code 
is changed into bit map data by the drawing section 905, and it is stored in the output 
buffer memory 511. The bit map data stored in the output buffer memory 5 1 1 are read 
according to the printing speed of printer engine 911, and are sent to printer engine 911 

through the engine interface 909. - - 

[0056] 

[Other operation gestalten] In addition, even if it applies this invention to the system 
which consists of two or more devices (for example, a host computer, an interface device, 
a reader, a printer, etc.), it may be applied to the equipments (for example, a copying 
machine, facsimile apparatus, etc.) which consist of one device. 

[0057] Moreover, it cannot be overemphasized by the purpose of this invention supplying 
the storage which recorded the program code of the software which realizes the function 
of the operation gestalt mentioned above to a system or equipment, and carrying out read- 
out activation of the program code with which the computer (or CPU and MPU) of the 
system or equipment was stored in the storage that it is attained. In this case, the function 
of the operation gestalt which the program code itself read from the storage mentioned 
above will be realized, and the storage which memorized that program code will 
constitute this invention. As a storage for supplying a program code, a floppy disk, a hard 
disk, an optical disk, a magneto-optic disk, CD-ROM, CD-R, a magnetic tape, the 
memory card of a non- volatile, ROM, etc. can be used, for example. 



[0058] Moreover, it cannot be overemphasized that it is contained also when the function 
of the operation gestalt which performed a part or all of processing that OS (operating 
system) which is working on a computer is actual, based on directions of the program 
code, and the function of the operation gestalt mentioned above by performing the 
program code which the computer read is not only realized, but was mentioned above by 
the processing is realized. 

[0059] Furthermore, after the program code read from a storage is written in the memory 
with which the functional expansion unit connected to the functional expansion card 
inserted in the computer or a computer is equipped, it cannot be overemphasized that it is 
contained also when the function of the operation gestalt which performed a part or all of 
processing that CPU with which the functional expansion card and functional expansion 
unit are equipped based on directions of the program code is actual, and mentioned above 
by the processing is realized. 
[0060] 

[Effect of the Invention] As explained above, according to this invention, in the image 
processing system which performs image rotation processing to image data, and its 
approach, the storage capacity of the memory which stores image data is reducible. 



[Translation done.] 
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